EUROPHYSICS LETTERS 1 April 1995 

Europhys. Lett, 29 (6), pp. l-oo (1998) 



An H-Theorem for the Lattice Boltzmann Approach to 
Hydrodynamics 

Alexander J. Wagner 

Theoretical Physics, University of Oxford, 1 Keble Rd., Oxford 0X1 3BN, Great Britain 

(received ; accepted ) 

PACS. 05.20.-y - Statistical Mechanics. 

PACS. 05.70.Ln- Non-equilibrium thermodynamics, irreversible processes. 
PACS. 47.11. +j - Computational methods in fluid dynamics. 



Abstract. - The lattice Boltzmann equation can be viewed as a discretization of the contin- 
uous Boltzmann equation. Because of this connection it has long been speculated that lattice 
Boltzmann algorithms might obey an H-theorem. In this letter we prove that usual nine- velocity 
models do not obey an H-theorem but models that do obey an H-theorem can be constructed. 
We consider the general conditions a lattice Boltzmann scheme must satisfy in order to obey 
an H-theorem and show why on a lattice, unlike the continuous case, dynamics that decrease 
an H-functional do not necessarily lead to a unique ground state. 



Introduction. - The lattice Boltzmann approach is a method for the simulation of hydrody- 
namic flow that was originally developed as a model to directly simulate the statistical average 
densities of lattice gas models. However, deriving the collision term for the lattice Boltzmann 
model from a lattice gas collision term unnecessarily restricts the Boltzmann model. Early 
lattice Boltzmann methods also suffered from the exclusion principle (i.e., there can be at most 
one particle at a given site), leading to an anomalous prefactor in the Navier Stokes equation 
that breaks Galilean invariance pi. This constraint was removed in the linearized lattice 
Boltzmann model first introduced by Higuera and co-workers 0), where it was observed that 
the collision operator can be linearized around a local equilibrium and need not correspond 
to the detailed choice of collision rules of the lattice gas automata, provided the operator 
conserves mass and momentum. 

A further simplification was introduced by Qian, d'Humieres and Lallemand ||, who 
proposed using the Bhatnagar-Gross-Krook (BGK) approximation || for the collision term in 
the lattice Boltzmann method. This approximation writes the collision operator as a function 
of the difference between the value of the distribution function and the equilibrium distribution 
function. For a recent review on the lattice Boltzmann method see ||. 

Another interpretation of the lattice Boltzmann approach is as a discretized version of the 
continuum Boltzmann equation. The microscopic derivation of an H-theorem has been given 
by Boltzmann for the famous Boltzmann equation (see 0). An H-theorem states that a 
functional can be defined which is a strictly decreasing function in time. For the continuous 
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Boltzmann equation this is the famous H-functional 

H(t) = JdxJ dv/(x,v,i)ln(/(x,v,i)). (1) 

Boltzmann was able to prove that for his equation dH Jf^ < 0. This corresponds to the second 
law of thermodynamics, which states that the entropy is a monotonically increasing function 
in time. Isothermal situations are often considered for lattice Boltzmann simulations so the 
energy is not conserved. In this case an H-functional will no longer correspond to the entropy, 
but rather to the free energy, which has a monotonic time behaviour in thermodynamics. 

In this letter we analyse the general conditions under which a BGK lattice Boltzmann 
model can obey an H-theorem. We show that lattice Boltzmann schemes do not automatically 
obey an H-theorem. It is possible, however, to define lattice Boltzmann schemes that do 
obey an H-theorem. For lattice gases Henon proved an H-theorem if the collision rules obey 
semi-detailed balance jl]]. This letter for the first time describes an H-theorem for lattice 
Boltzmann schemes. 

In the next section we will introduce a general BGK lattice Boltzmann scheme. We then 
examine which general properties we can deduce for a lattice Boltzmann scheme that obeys 
an H-theorem. This will lead to a consistency condition for the equilibrium distribution. We 
then show that any lattice Boltzmann scheme with an equilibrium distribution that obeys the 
consistency condition will also obey an H-theorem, and we can construct the H-functional. 
Lastly we show that usual equilibrium distributions do not obey the consistency condition and 
construct one example that does obey it. 



The BGK lattice Boltzmann scheme. For a single component fluid the BGK lattice 
Boltzmann evolution equation is 

/ i (x + v i At,t + At) = / i (x,*) + ^(/p(x,t)-/ i (x,*)) (2) 

where x is a discrete vector to a lattice site and the Vj's are velocity vectors. These are 
chosen in a way such that v^A£ = ej is a lattice vector of the underlying lattice. Formally the 
evolution can be decomposed into two steps: the streaming step and the collision step. The 
collision step collides the densities according to 

/,°(x,t) = /<(x,t) + ^ (/°(x,t) - / 4 (x,i)) (3) 

and the streaming step moves the density on the lattice according to 

/i(x + ViAt,t+At) = /f(x,t). (4) 

Combining equations (||) and recovers the full evolution equation (|J) . Many lattice Boltz- 
mann applications are isothermal and do not conserve energy so the H-functional corresponds 
to the free energy instead of the entropy. The case of an isothermal model and a model that 
conserves energy can thus be treated equivalently for our purpose. We will point out the 
differences where they arise. 

The local density n(x, t), the local net velocity u(x, t) and, for a thermal model, the local 
kinetic energy e(x, t) are given by 

N N N 

n =yz /*> nu = m and ne = /*i vi i 2 ' ( 5 ) 

i=0 i=0 i=0 
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where the sum is over the N velocity vectors, Vj, of the model. In order for this approach to 
simulate the continuity, the Navier-Stokes and, for a thermal model, the heat equation, the 
equilibrium distribution, /°, has to respect the conservation of mass, momentum and energy. 
To reproduce the right form of the transport coefficients it has to respect additional con- 
straints, namely higher order velocity moments of the /» have to correspond to the equivalent 
moments of the continuum Boltzmann distribution (although this is often relaxed for practical 
applications e.g. by restricting the method to incompressible flow). 

The H-Theorem. - Let us now consider whether or not the scheme described can obey an 
H-theorem. If we have a functional that always decreases in time, then the H-functional must 
be locally minimal if the distribution function is the equilibrium distribution. 

To derive the general form of this H-functional we will show that the streaming step can not 
change the value of the H-functional. Let us consider the collisionless limit (r — > oo) where 
we have only streaming. In a periodic system it follows that the time evolution also has to 
be periodic for L\ steps if L is the number of lattice sites. Thus, if this system obeys the 
H-theorem, the streaming step cannot change the H functional. 

A different way of seeing that the H-functional has to be invariant under the streaming step 
is to consider a system for which the H functional has the value Hi and then to perform a 
streaming step to a new system for which the H-functional has the value H^. If the evolution 
obeys an H-Theorem, it follows that H\ > H^. We then invert all the velocities. It seems 
reasonable to assume that this operation should not change the value of the H-functional. If 
we now perform a streaming step on the new system, we arrive at the original system with 
inverted velocities, and we can conclude Hi > Hi and, therefore, Hi = Hi. 

From the invariance of the H-functional under the streaming step we can conclude that 
there can be no cross-terms between the densities in the H functional. It can therefore be 
written as a sum of functions of the ft separately: 

L N 

#[{/*}](*) = EE m/^,*)], ( fi ) 

1=1 i=0 

where L is the number of lattice points and I is an index that numbers all points of the lattice. 

The equilibrium distribution, ff, is the distribution that minimizes the H-functional under 
the constraint that its moments have the same values for the conserved quantities of the 
distribution before the collision. We can eliminate this constraint by introducing Lagrange 
multipliers into the the H-functional: 

N / N \ / N \ / N \ 

Ham = E M/o - a E fi - n - b E /* v * - nu - c E /'W 2 - ne • ( ? ) 

i=0 \i=0 / \i=0 / \i=0 / 

The variation of the H-functional has to vanish for the equilibrium distribution. We therefore 
obtain for the variation 

N 

SH[{.h}} - E ^ (WO - o - bvi - cvl) (8) 

i=0 

Because the Sfi are independent, the terms for all i have to vanish independently at equilib- 
rium. This gives us the consistency condition for the local equilibrium distribution 



/? = h i '-\a + hw i + cv 2 i ). 



(9) 
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This yields a unique definition for /° if the h! i are strictly monotonic, i.e., if the hi are convex. 
The Lagrangian multipliers are determined by the conservation constraints 

N N N 

n = ^/j°, nu = ^ /"v; and, for a thermal model, ne = /"|vj| 2 . (10) 

For an isothermal model we use c = in equation (Q) . 

Local H-Theorem. - We can now show that for the collision step @ with an equilibrium 
function that obeys the consistency condition (||), the value of the H- functional decreases. 
Because are only concerned with the collision term we drop the x dependence. We then get 
for the time development of the local H-functional H l 

H e [{fi}](t + At) - H'Uft}]® < 0, VAt < r. (11) 

The constraint At < r excludes over-relaxation, which is often used to simulate high Reynolds 
number flow because the viscosity for lattice Boltzmann schemes has a factor r — (At)/2. The 
condition t = (At) /2 corresponds to a vanishing viscosity, and one can prove that in this limit 
no H-theorem can exist. The case of (At)/2 < r < At is an interesting problem that still 
warrants closer investigation. 

We now provide the proof for the H-theorem. It is technically difficult to prove it for discrete 
time steps. As a mathematical simplification we introduce a continuation of the definition of 
the densities for continuous time in the collision step (^|) . The continuation is chosen so that the 
densities obey the conservation constraints at all times. For these continuous time densities 
we can then prove an infinitesimal H-theorem over which we integrate to obtain the exact 
H-theorem for discrete time. 
Proof: 

We define for real s G [0, At] 



M*+s) = /i(i) + -(/°-M*))- (12) 



Observe that f® = / z °(n,u, e) is the equilibrium distribution for all fi(s) since the conserved 
quantities are the same for all fi(s). 

Now we can prove the local H-theorem using the definition of H from (0) : 

H[{f i }](t + At) - H [{/,}] (t) 

At N 

ds^dfMMt + s )) - a fi(t + s) - b/i(t + «)vi - cfi(t + s)v 2 t 

i=0 

+ — (an + hnu + cne))d s fi(t + s) 

(12) f^^^u.u, ^ u 1 



pat 'i i 

/ ds J2 (,h/(h(t + a)) - o - by* - cvf) x-(f9- m) 

N . . 

ds^WW + «)) hi'(f?)) x - Mt + sj) 



< (13) 

if hi is non-decreasing or, equivalently, if h is convex. We have oe(s) = (1 — s/t) , which is 
always positive because s < At < t. 
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Global H-theorem. - The total entropy H[{fi}](t) defined in (||) is non-increasing at every 
lattice site in the collision step and is unchanged in the streaming step. We therefore have the 
global H-theorem 

H[{fi(x)}](t + At) - H[{fi(x)}(t)], < Vr > At. (14) 

The Global Equilibrium Distribution. - In statistical mechanics the H-theorem is used to 
prove the existence of a unique equilibrium state of the system. It will turn out that for lattice 
systems this is not necessarily the case. Demanding the existence of a well-defined ground 
state gives us a constraint for the structure of the lattice. This is equivalent to the constraint 
that there are no spuriously conserved quantities. 

Since we have a global H-theorem and the H-functional is bounded, we know that the 
scheme has to converge to some minimal value of the H-functional. We will now examine what 
information about the final state we can extract from our H-Theorem. 

Since the H-Functional does not change in the final state we know that it also cannot change 
locally in the collisions. Therefore the local distributions must be equilibrium distributions 
fi(t) = /P. We can conclude that for large t the system converges to a state that has local 
equilibrium distributions everywhere. Furthermore, the streaming step has to transform one 
state of local equilibrium into another (or the same) state of local equilibrium. 

Whether these conditions force the global equilibrium to be homogeneous depends on the 
lattice and the set of velocity vectors {v^}. This question is related to the problem of spurious 
invariants (see, for instance, and references therein). Spurious invariants are conserved 
quantities that do not correspond to any physical quantities. In a four-velocity model on a 
square lattice, for instance, the total momentum of all even and odd lattice sites is separately 
conserved. If the global equilibrium is constrained to be homogeneous, then there cannot be 
any spurious invariant. If, however, inhomogeneous final states are possible, then these state 
can be characterized by at least one spuriously conserved quantity. 

Why conventional lattice Boltzmann schemes cannot have an H-theorem. - We show that 
assuming an H-theorem leads to a structure of the equilibrium distribution that is different 
from the usual structure of the equilibrium distribution. The usual BGK lattice Boltzmann 
schemes have a polynomial equilibrium distribution. For an isothermal model it takes the form 

11110) 

/P = A a n + B a nu a v ia + C a nu a u a + D a nUa_upv ia v i(i , (15) 

where A a , B a , C a , and D a are constants and a is an index distinguishing velocities with 
different magnitudes. If this equilibrium distribution is to be derived from an H-functional of 
the form given in equation (^) then the h'^(x) have to be quadratic polynomials. We obtain 

fi = h/' 1 (a + b a v ia ) 

= a a + f3 a (a + b a v ia ) + j a (a + b a v ia ) 2 

= («<t + AjO + laO 2 ) + (Ax + 2j a a)b a V ia + Jab a bpV ia Vip (16) 

where the coefficients ct a , (3 a and 7 CT are constants that cannot depend on n or u. The Lagrange 
multipliers a and b a are determined by the conservation laws. In order for the coefficients in 
( ^6[ ) to be linear in n, we require a a — (3 a — 0. Evaluation shows that the resulting coefficients 
are not quadratic in u a for any choice of In particular, we get 



2 7i + 272 + VvTi + 2 72 )(-2m 2 7o + (1 - 8m 2 )7i + 2(1 - 4u 2 ) 72 ) 

a = n 7T, ^ T7 77 77 (!') 

2(7i + 272X70 + 4(7i +72)) 
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which has a more complicated u dependence for all 7 CT than equation (|l5|). All lattice Boltz- 
mann schemes of which we are we are aware have a polynomial u dependence and therefore 
cannot obey an H-theorem. 

A lattice Boltzmann scheme with an H-theorem. - If we use the classical choice for the 
H-functional 



l i 

for a thermal model, i.e., a model with mass, momentum and energy conservation, we get for 
the equilibrium equation a Maxwell-Boltzmann distribution 



where N , U and T are the Lagrange multipliers. This scheme simulates the continuity, Navier- 
Stokes and heat equations to an approximation that depends on the choice of lattice (because 
the higher order moments needed for the Chapman Enskog expansion do not necessarily 
coincide for the discrete and continuum case). Unfortunately, the Lagrange multipliers cannot 
be expressed analytically in terms of the conserved quantities, but have to be found by 
numerically solving the non-linear equation. For a regime where the Navier-Stokes and heat 
equations are recovered, the Lagrange multipliers are well approximated by U ~ u and 
T ~ 6 — l/d(e — mi 2 ), where d is the number of spatial dimensions. 

The advantage of this scheme is that it is numerically stable for r > At. This is ensured 
by the H-theorem because numerical instabilities lead to inhomogeneities that would increase 
the H-functional. 

Conclusions. - We have shown how lattice Boltzmann models can be constructed to obey 
an H-theorem and that the usual choice of the equilibrium distribution is incompatible with 
an H-theorem. For traditional schemes no H-functional can exist. 

It will be interesting to investigate further examples and applications of lattice Boltzmann 
methods which obey an H-theorem. One apparent advantage of these schemes is the numerical 
stability that results from the constraint which minimizes the H-functional. We believe that 
constructing lattice Boltzmann schemes with H-functionals will help to improve the stability 
lattice Boltzmann schemes. 



It is a pleasure to thank Dominique d'Humieres and Colin Marsh for several helpful discus- 
sions. 
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